Solution of Graph - Composed Markov Models Using
نویسندگان
چکیده
Continuous time Markov chains (CTMCs) are a common mathematical model for studying the dependability of many complex processes and have been especially successful in modeling large computer systems. CTMCs are typically generated from more natural modeling formalisms that often better represent the system they model. This results in the famous state-space explosion problem, in which the number of states in the CTMC depends exponentially on the number of models in the higher-level formalism. The problem affects numerical analysis in two ways: the space needed to represent the transition rate matrix, and the space needed to represent the iteration vectors. The goal of this thesis is to develop new techniques to extend the size of models that can be studied using CTMCs generated from higher-level formalisms. To combat the state-space explosion problem, we present a combination of a largeness-avoidance and a largeness-tolerance technique to address the size of the transition rate matrix. In the first technique, we present a representation of the model called the model composition graph, which separates a model into its public and private state. We then use symmetry detection to generate the smallest CTMC possible using model-level symmetry. In the second technique, we use symbolic data structures to represent the state space and transition rate matrix using minimal memory, leaving the rest for iteration vectors. We combine the techniques for the case of graph-composed Markov models with state-sharing composition. Using several example models, we study the space and time efficiency of the techniques. We present results showing an orders of magnitude decrease in running time due to lumping of modellevel symmetry, and an orders of magnitude decrease in space due to symbolic data structures. Since our techniques are complementary, we are able to get the benefits of both, which greatly improves our ability to solve these types of models.
منابع مشابه
Introducing Busy Customer Portfolio Using Hidden Markov Model
Due to the effective role of Markov models in customer relationship management (CRM), there is a lack of comprehensive literature review which contains all related literatures. In this paper the focus is on academic databases to find all the articles that had been published in 2011 and earlier. One hundred articles were identified and reviewed to find direct relevance for applying Markov models...
متن کاملAsymmetric Effects of Monetary Policy and Business Cycles in Iran using Markov-switching Models
This paper investigates the asymmetric effects of monetary policy on economic growth over business cycles in Iran. Estimating the models using the Hamilton (1989) Markov-switching model and by employing the data for 1960-2012, the results well identify two regimes characterized as expansion and recession. Moreover, the results show that an expansionary monetary policy has a positive and statist...
متن کاملSpatial count models on the number of unhealthy days in Tehran
Spatial count data is usually found in most sciences such as environmental science, meteorology, geology and medicine. Spatial generalized linear models based on poisson (poisson-lognormal spatial model) and binomial (binomial-logitnormal spatial model) distributions are often used to analyze discrete count data in which spatial correlation is observed. The likelihood function of these models i...
متن کاملAccelerated decomposition techniques for large discounted Markov decision processes
Many hierarchical techniques to solve large Markov decision processes (MDPs) are based on the partition of the state space into strongly connected components (SCCs) that can be classified into some levels. In each level, smaller problems named restricted MDPs are solved, and then these partial solutions are combined to obtain the global solution. In this paper, we first propose a novel algorith...
متن کاملبررسی قابلیت تحمل پذیری خطا در شبکه های حسگر بی سیم
To increase reliability and fault tolerance in wireless sensor network, using spare nodes is a useful method. In this article, we survey the influence of using single-type and multi-type spare nodes on the fault tolerance in the low density. To achieve this, we use single-type and multi-type spare nodes and construct the network reliability graph for one, two and three-node densities. Then, we ...
متن کامل